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5 

Technical Field 

The present invention relates generally to computer systems, and more particularly to 
a system and method to enable smooth mixing and integration of a selected foreground image 
1 0 with an unassociated background image by determining subpixel image areas along a contour 
of the foreground image. 



Background of the Tnventinn 

Digital images and related image processing have created a profound impact in all 
1 5 aspects of modem society. From blockbuster movies to the classroom, from business 

presentations to the daily weather report, digital images affect and influence people - dozens, 
perhaps, hundreds of times per day. For example, with the advent of communications 
technologies such as the Intemet, business persons, students, researchers and ordinary 
citizens routinely transmit and receive digital images in the normal course of daily activity. 
20 Thus, since digital images have become a staple in modem society, ever changing and more 
sophisticated requirements for image processing are consistently challenging systems 
designers and architects. 

One such challenge relating to image processing is associated with seamlessly 
combining portions of a first image with portions of a second image. For example, when 
25 observing the nightly weather report, the image of the weather person is often interposed with 

a plurality of background screens depicting various weather patterns. In the case of high-tech 
movie special effects and/or other computer generated images, an object, person and/or scene 
portion, known as the foreground, is often digitally extracted from an associated background 
scene and placed into a second scene having entirely different backgrounds from the first 
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scene. In order to accomplish this type of image extraction and migration however, it is 
important that remnants or artifacts of the first scene do not appear in the second scene, and 
that the extracted object, person or scene portion seamlessly migrate into the second scene. 
In other words, the migrated foreground image should appear without rough edges and appear 
5 as though the new background scene was the original background. Unfortunately, 

conventional image processing systems many times do not effectively achieve these goals. 

One such conventional model for extracting foreground image regions from an 
associated background region relates to utilizing an artificial/engineered and/or clean 
background (e.g,, blue screen), and extracting the foreground image from the artificial 

1 0 background via a background subtraction technique. This may be achieved by processing 
image pixels and determining whether a threshold level has been attained after subtracting 
known background pixel values from each pixel value in the image. For example, according 
to the conventional model, given the known background pixel values of the artificial 
background, the known background pixel value is subtracted from each pixel in the image 

1 5 and compared to a predetermined threshold. If the result of the subtraction is below the 

predetermined threshold, the pixel is assumed to be a background pixel and thus not assigned 
a value in the extracted image. If the result is above the predetermined threshold, the pixel is 
assumed to be a foreground pixel and thus retains its original value. Unfortunately, 
background subtraction and other extraction techniques may not cleanly separate foreground 

20 regions of the image and enable smooth placement of the foreground onto a new background. 

Some of the problems associated with these techniques relate to "bluescreen" reflections in 
the extracted foreground, potential "holes" in the foreground, wherein the values of the 
foreground and background are mixed, jagged edges along the contours of the extracted 
image, and "bleeding" of the previous background into the new background. Moreover, 

25 providing artificial clean backgrounds is often not possible and/or difficult to achieve. 

In view of the above problems associated with conventional image processing 
systems, there is a need for a system and/or methodology to facilitate precise extraction of a 
foreground region of an image from an associated background region, and to enable smooth 
migration of the foreground region to other background regions. 
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Snmmary of the Tnyentinn 

The following presents a simplified summary of the invention in order to provide a 
basic understanding of some aspects of the invention. This summary is not an extensive 
overview of the invention. It is intended to neither identify key or critical elements of the 
5 invention nor deHneate the scope of the invention. Its sole purpose is to present some 

concepts of the invention in a simplified form as a prelude to the more detailed description 
that is presented later. 

The present invention relates to a system and methodology for enabling portions of 
image regions to be extracted from adjacent background regions via a sub-pixel edge offset 

1 0 determination at the contours of the extracted image region. In this manner, blurring effects 

and unwanted background portions are mitigated in the extracted image region. Generally, an 
image pixel represents a non-zero area on an imaging plane wherein pixels on a region 
contour tend to straddle both a foreground and a background. Thus, a contour pixel is 
generally a mixture of both a foreground color and a background color. This mixture may be 

1 5 modeled linearly as follows: I = oF + (l-a:)B, wherein I represents the actual pixel value, F is 

the foreground color, B is the background color, and a is the alpha value which represents a 
mixing ratio of foreground and background colors. Since the I value is known fi-om a given 
image, a, F and B are to be determined. 

More particularly, the present invention may determine F as follows: the foreground 

20 value may be selected as the color (or intensity value) that a pixel may assume had the pixel 

been entirely occupied by an extracted and/or cut-out object. Because of image smoothness, 
it may be expected that a nearby pixel from the foreground side of a contour may have a 
similar value. Thus, according to one aspect of the invention, an F value for a given contour 
pixel may be borrowed from the nearest foreground pixel. It is to be appreciated that there 

25 are many other possibilities for determining the F value, as will be described in more detail 

below. 

The rvalue maybe determined by computing a local edge orientation and sub-pixel 
edge-offset associated with the contour of the extracted image. This may be achieved by 
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computing image gradients and edge locations relating to the geometry, direction, and 
intensity of the contour. For example, sub-pixel offsets may be determined by computing an 
intensity gradient and intensity gradient magnitude for each contour pixel and associated 
pixel neighborhood. The intensity gradient enables computation of the orientation of the 
5 edge of a contour pixel, if an edge exists. Intensity gradient magnitudes are then sampled in a 

direction perpendicular to the edge orientation. An optional anisotropic smoothing may also 
be applied in the direction parallel to the edge orientation. A curve fit is then applied to the 
intensity gradient magnitude to determine a peak intensity gradient value wherein the edge's 
degree of offset from the center of the contour pixel may then be determined. The fraction of 

10 the pixel that overlaps the foreground side of the line drawn with computed orientation and 

offset is therefore a. Thus, improved image extraction from a background region may be 
achieved over conventional systems. It is to be appreciated that a background color B may be 
similarly selected as described above for F when determining alpha. Alpha is then 
determined as 1 minus the fraction of the pixel that overlaps the background side of the line 

1 5 drawn with computed orientation and offset. 

In accordance with one aspect of the present invention, a system for selecting a 
foreground region of an image, given a set of pixels defining the boundary of the foreground 
region of the image, is provided. The system includes a component to determine a 
foreground value (F) and opacity value (a) for each pixel on the set wherein a is determined 

20 via a subpixel edge-offset to facilitate a separation the foreground region from background 

portions of the image and combining the foreground region with background portions from a 
new image. 

According to another aspect of the present invention, a method for integrating 
extracted images is provided. The method includes: selecting a set of contour pixels defining 
a foreground region of an image; determining a subpixel edge offset from the center of each 
contour pixel; and determining an area of a portion of each contour pixel utilizing the 
subpixel edge offset to determine an opacity value (a) for each contour pixel. 
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According to yet another aspect of the present invention, a system for integrating 
extracted images is provided. The system includes: means for selecting a set of contour 
pixels defining a foreground region of an image; means for determining a subpixel edge 
offset fi-om the center of each contour pixel; and means for determining an area of a portion 
of each contour pixel utilizing the subpixel edge offset to determine an opacity value (a) for 
each contour pixel. 

In accordance with another aspect of the present invention, a signal is employed that 
facilitates integration of extracted images. The signal communicates information associated 
with an image. A first component is provided for selecting a set of contour pixels defining a 
foreground region of the image via the signal, wherein the component determines a subpixel 
edge offset fi-om the center of each contour pixel, and determines an area of a portion of each 
contour pixel utilizing the subpixel edge offset to determine an opacity value (a) for each 
contour pixel. A second component utilizes the opacity value (a) via the signal to smoothly 
mix the foreground region of the image with a subsequent background region associated with 
another image. The signal may be communicated over at least one of a network system, such 
as the Internet, and/or a wireless system. 

The following description and the annexed drawings set forth in detail certain 
illustrative aspects of the invention. These aspects are indicative, however, of but a few of 
the various ways in which the principles of the invention may be employed and the present 
invention is intended to include all such aspects and their equivalents. Other advantages and 
5 novel features of the invention will become apparent fi*om the following detailed description 

of the invention when considered in conjunction with the drawings. 

Brief Description of the Drawings 

Fig. 1 is a schematic block diagram illustrating an image processing system in 
1 0 accordance with an aspect of the present invention; 

Fig. 2 is a diagram illustrating a contour edge within a subset of contour pixels in 
accordance with an aspect of the present invention; 
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Fig. 3 is a diagram illustrating a contour edge orientation within an image in 
accordance with an aspect of the present invention; 

Fig. 4 is a diagram illustrating a resultant vector of a contour edge orientation 
determination in accordance with an aspect of the present invention; 
5 Fig. 5 is a diagram illustrating a contour edge offset determination in accordance with 

an aspect of the present invention; 

Fig. 6 is a diagram illustrating an interpolation in accordance with an aspect of the 
present invention; 

Fig. 7 is a diagram illustrating an isotropic smoothing within an image in accordance 
1 0 with an aspect of the present invention; 

Fig. 8 is a diagram illustrating a subpixel area determination in accordance with an 
aspect of the present invention; 

Fig. 9 is a flow chart diagram illustrating a methodology for enabling image 
extraction and smooth mixing with a new background in accordance with an aspect of the 
1 5 present invention; and 

Fig. 10 is a schematic block diagram illustrating a suitable operating environment in 
accordance with an aspect of the present invention. 

Detailed Description of thp Tnvi^ntiftn 

20 The present invention is now described with reference to the drawings, wherein like 

reference numerals are used to refer to like elements throughout. 

The present invention relates to a system and methodology to facilitate removal of a 
foreground region of an image from an associated background region and to enable smooth 
mixing of the foreground region with a second and/or subsequent background region. This 

25 may be achieved by selecting a chain and/or grouping of pixels defining a contour of the 

foreground region that is to be extracted from the background region, and determining a 
subpixel area for the foreground or background portions of the contour pixels, respectively. 
The chain of pixels defining the foreground region of the image generally includes a mixture 
of both desired foreground colors and background colors that are to be removed. A mixing 
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ratio known as alpha which defines the mixing ratio of foreground colors and background 
colors may be determined by computing the area of either the foreground region or the 
background region within a contour pixel, Subpixel edge offsets may be utilized along the 
chain of pixels to determine the proportion of area occupied by both the foreground and 
5 background colors of the contour pixels. Upon determining alpha, the extracted foreground 
image may be mixed with a subsequent background image wherein the pixel edges of the 
extracted image are mixed with the new background image according to the mixing ratio 
defined by alpha. Thus, smooth mixing of the extracted foreground with the subsequent 
background is achieved by determining alpha in accordance with the present invention. 

10 Referring initially to Fig. 1, a system 10a illustrates an image processing system in 

accordance with an aspect of the present invention. An image 20a having both a foreground 
region 20b and a background region 20c is processed in accordance with the present 
invention, wherein the foreground region 20b is extracted fi*om the image 20a and transferred 
to a second and/or subsequent image 30a, having a different background region 30c. A 

1 5 contour definition system 40 is employed to define a chain or grouping of contour pixels 50 

which are associated with the exterior of the foreground region 20b. The contour definition 
system 40 may be substantially any well-known system for selecting the contour pixels 50 of 
the foreground region 20b. These systems may include for example, "Intelligent Scissors" 
(as described in (Mortensen, E.N. and Barrett, W.A., "Intelligent scissors for image 

20 composition" SIGGRAPH 95 Proceedings, 1995) as well as other suitable systems that 

provide foreground pixel contour definitions/selections. These systems enable a user and/or 
system to select/define the exterior of the foreground region 20b (e.g., mouse selection, area 
defined by an overlaid object on the image) and output the chain or grouping of contour 
pixels 50 associated with the selection/definition of the foreground region. 

25 Upon selecting the contour pixels 50 of the image 20a, a subpixel mixture analysis 

system 60 is employed to determine a mixing ratio alpha 64 to enable smooth mixing of the 
foreground region 20b with the background region 30c. By determining alpha 64, the amount 
of foreground color attributed to the contour pixels 50 may be determined. Additionally, the 
mixing ratio alpha 64 enables smooth mixing of the background region 30c with the contour 
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pixels 50 by enabling substantially the same proportion of the background region 30c to be 
mixed as was the proportion of the background region 20c. As will be described in more 
detail below, alpha may be determined by the local edge orientation and subpixel offset of the 
contour pixels 50. Upon determining the edge orientation, a subpixel edge offset may be 
5 computed wherein the area defined by the foreground or background colors that reside within 

a contour pixel maybe utilized to determine alpha. 

Turning now to Fig. 1, a subset 70, of the contour pixels 50, having an associated 
contour edge 80 are illustrated in accordance with an aspect of the present invention. It is to 
be appreciated that the contour pixels 50 may include a plurality of pixels, wherein each pixel 

1 0 along the contour is processed as described below. For example, the subset of contour pixels 

70 depicts six exemplary contour pixels 72a-72f As illustrated, a portion of the contour edge 
80 traverses through portions of the pixels 72a-72f, wherein the pixels may straddle both the 
foreground and background regions of the image 20a as depicted in Fig. 1 . The foreground 
regions associated with the contour edge 80 are depicted by the letter (F), whereas the 

1 5 background regions are depicted by the letter (B). Since both the background and foreground 

colors are mixed within the pixels 72a-72f, the image pixel value (e.g., intensity value) is 
described by the mixed value and is denoted by the letter (I). 

The mixture maybe modeled linearly as follows: I = oF + (l-a)B, wherein I 
represents the actual pixel value, F is the foreground color, B is the background color, and a 

20 is the alpha value which represents the mixing ratio of foreground and background colors. 

Since the I value is known from a given image (e,g., reading pixel memory locations), a, F 
and B may be determined as described below. The foreground value may be selected as the 
color (or intensity value) that a pixel may assume had the pixel been entirely occupied by the 
extracted and/or cut-out object (e.g., area inside the contour 50 as depicted in Fig. 1). 

25 Because of image smoothness, it may be expected that a nearby pixel from the foreground 

side of the contour pixels 50 (e.g., region within the contour) may have a similar value. 
Thus, according to one aspect of the invention, the F value for a given contour pixel maybe 
borrowed from the nearest foreground pixel. It is to be appreciated that there are many other 
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possibilities for determining the F value. For example, F values may be determined via (1) 
an average of several nearby foreground pixels, (2) a stochastically selected, weighted 
average of nearby pixels, (3) a pixel generated by a texture reconstruction process applied to 
nearby foreground pixels, as well as (4) a mixture of the I value and the pixel value generated 
5 by any of ( 1 -3)) above. 

Alpha is then determined by computing the area occupied by F within each contour 
pixel 72a-72f, which is described in more detail below. For example, the ratio of the area 74a 
occupied by the foreground F in the pixel 72d divided by the combined area of the pixel 72d 
yields the mixing ratio alpha. Since the area of the pixel 72d may be normalized to one, 

1 0 alpha may be determined as the area occupied by F. It is to be appreciated that similar 
determinations may occur for the background regions B, wherein background colors are 
selected for B as described above for selecting colors associated with F. Alpha is then 
determined as 1 minus the fraction of the pixel that overlaps the background side of the hne 
drawn with computed orientation and offset and F is determined by substitution of I, B 

1 5 into the linear model I =^ oF + (l-a)B. As will be described in more detail below, subpixel 
edge orientations are determined for the contour pixels 50 which enable a contour edge offset 
to be computed such as for the areas 74a and/or 74b to yield a value for alpha. 

Referring now to Fig. 3, an exemplary subpixel edge orientation determination is 
illustrated in accordance with an aspect of the present invention. An image 84 is depicted 

20 having the pixel 72d with a contour edge portion 86 adjacent to nearby neighboring pixels 

90a-90h, wherein a dark region within each pixel represents the intensity value of the pixel at 
the center of the pixel. It is to be appreciated that more or less pixels may be employed in 
determining the edge orientation and subsequent edge offset in accordance with the present 
invention. It is fiirther to be appreciated that the following description for determining 

25 subpixel edge orientations and offsets are but one of many well-known image processing 
techniques for determining the contour edge orientation within a pixel and associated edge 
offset within a pixel, if any. It is noted that before image processing is commenced, a 
Gaussian smoothing function may be applied to the image 84 in order to filter potential pixel- 



9 



MS 158300.1 

wide noise sources. Gaussian smoothing is performed by convolving the image 84 with a 
Gaussian operator which is defined below: 

Equation 1: 

g(x, y) = -J-^e-^-^^^>^^- 

2 71(7 ^ 

5 wherein ^ is the standard deviation representing the width of a Gaussian distribution. 

The shape of the distribution and hence the amount of smoothing can be controlled by 
varying ^, In order to smooth an image /(^j;), the image may be convolved with g{x^y) to 
produce a smoothed image ^(x,^), wherein s{x,y) =J{x,y)'^g(x,y). 

The edge orientation (e.g., direction the contour edge portion 86 is in relation to the 
1 0 pixel 72d) may be determined by taking the gradient of the image 84 with respect to the X 

and Y directions depicted in Fig. 3 from the contour pixel 72d. The gradient computation 
may be directed at intensity values (I) associated with each pixel 72d, 90a-90h, for example 
as illustrated in Equation 2 below: 

15 Equation 2: 

VI(x, y) = dVdx i + 31/ dy j 

After determining the gradient of the image 84 from the center of the pixel 72d, a 
resultant gradient vector 100 as depicted in Fig. 4, defines the orientation of the contour edge 

20 portion 86. The gradient vector 100 is perpendicular to the orientation of the contour edge 

portion 86, since image intensity changes most rapidly in the direction of the edge. Thus, an 
edge 104 line may be determined through the center of the pixel 72d which is parallel to the 
actual contour edge portion 86 and perpendicular to the gradient vector 100. As depicted in 
Fig. 4, the contour edge portion 86 is generally offset from the center of the pixel, thus further 

25 determinations involve computing the amount of offset required to shift the line 104 to the 

position of the contour edge portion 86. Upon determining the amount of shift for the line 
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104, an area 106 may then be determined for the foreground portion of the pixel 72d which 
defines the mixing ratio alpha. 

Turning now to Fig, 5, one possible edge offset determination is illustrated in 
accordance with the present invention. Since the edge line 104 that was determined firom the 
5 gradient vector computation above is through the center of the pixel 72d, a shift 

determination is performed to determine how far the edge line 104 is from the actual contour 
edge portion 86. This may be achieved by computing gradient magnitude points along the 
gradient vector 100 and fitting a curve 1 10a to the points, for example. By determining how 
far a peak 1 1 Ob of the curve 1 1 Oa is from the center of the pixel 72d, an offset for the line 

10 1 04 may be computed. 

To further illustrate the offset determination, three exemplary gradient magnitude 
points 1 12a- 1 12c are illustrated along the gradient vector 100. It is to be appreciated that a 
plurality of points along the vector 1 00 may be similarly determined. It is further noted that 
the gradient magnitude points may be determined at equal pixel distances away (e.g., 1 ,2,3 

15 pixel distances) and/or at subpixel distance away {e.g„ 1/3,1/2, 2/3 pixel distances) from the 

center of the pixel 72d. The gradient magnitude points 1 12a- 1 12c may be computed from the 
following Equation: 

Equation 3: 

20 |VI(x, y) 1::= ^l(dl/dx)' + (dydy)' 

It is also noted that gradient magnitude points along the gradient vector 100 generally 
do not fall at the center of adjacent/neighboring pixel locations. Thus, some form of 
interpolation is generally performed in order to determine a gradient magnitude value that is 
25 offset from the center of a pixel. For example, referring briefly to Fig. 6, one possible 

interpolation process is illustrated. As illustrated, the gradient magnitude points 1 12a and 
1 12c do not fall at the center points of neighboring pixels 90d and 90e, respectively. Thus, 
bilinear interpolation may be performed wherein the center pixel values from pixels 90a, 90b, 
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90d and 72d are employed to compute the gradient magnitude at point 1 12c. Similarly, the 
center pixel values from pixels 90b, 90c, 90e and 72d are employed to compute the gradient 
magnitude at point 1 12a. It is to be appreciated that other well-known interpolation processes 
may be employed to determine intermediate gradient magnitude values along the vector 100. 
5 For example, bi-cubic interpolation may be employed wherein the values from 16 

neighboring pixels are utilized to determine off-center gradient magnitude values. 

Referring back to Fig. 5, upon determining the gradient magnitude points 1 12a-l 12c, 
the curve 1 10a is fit to the gradient magnitude points. For example, a quadratic curve may be 
fit to the points 1 12a-l 12c. It is to be appreciated that substantially any curve fitting 

1 0 technique may be employed to fit the curve 1 1 Oa such as a higher order polynomial and/or 
regression technique. After the curve 1 10a has been fit to the gradient magnitude points, the 
peak 1 10b of the curve 1 10a generally is aligned with the intersection of the subpixel contour 
edge portion 86 and the gradient vector 100. The edge line 104 which is through the center 
of the pixel 72d is then offset by an amount "D" along the curve 1 10a to the contour edge 

1 5 portion 86, As will be described in more detail below in relation to Fig. 8, upon determining 
the edge offset, an area computation may be performed to determine the mixing ratio alpha. 

Referring briefly to Fig. 7, an optional anisotropic smoothing may be applied to the 
image along the vector 104 during the gradient magnitude determinations described above. 
This step involves taking a plurality of image samples 1 1 8a- 1 1 8f, for example, along the 

20 gradient vector 100 and parallel to the direction of the edge. For example, samples 1 18a and 
1 1 8d are parallel to samples 1 1 8b and 1 1 8e, which are parallel to the contour edge portion 
86, It is to be appreciated that other samples may similarly be determined. Anisotropic 
smoothing, which is well understood, involves averaging gradient magnitude values that are 
in line with the parallel samples. The averaging may also be weighted by a Gaussian 

25 fimction, wherein the center values 1 12a, 1 12b, and 1 12c are emphasized over other 

neighboring values. 

Referring now to Fig. 8, a subpixel area determination is illustrated for determining 
the mixing ratio alpha in accordance with the present invention. After determining the edge 
offset as described above, a foreground area portion Fa 120 may be defined for the portion of 
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the foreground that is mixed at the subpixel level within the pixel 72d. The foreground area 
portion 120 is defined by the contour edge portion 86 determined above, and sides 122a and 
122b that are intersected by the contour edge portion 86. The foreground area 120 may thus 
be determined by integrating the function defined by the contour edge portion 86 over the 
5 region encompassed by the sides 122a and 122b of the pixel 72d. The mixing ratio alpha is 

then the ratio of the computed area 120 divided by the entire area of the pixel 72d. Since the 
area of the pixel may be normalized to unity, the area 120 is thus alpha. As described above, 
a background area portion Ba 126 maybe similarly computed as the foreground portion 120. 
In this case however, alpha would then determined as 1 minus the fi*action of the pixel that 

10 overlaps the background side of the line drawn with computed orientation and offset. 

Fig. 9 illustrates a methodology for providing smooth image mixing in accordance 
with an aspect of the present invention. While, for purposes of simplicity of explanation, the 
methodology is shown and described as a series of blocks, it is to be understood and 
appreciated that the present invention is not limited by the order of blocks, as some blocks 

1 5 may, in accordance with the present invention, occur in different orders and/or concurrently 

with other blocks from that shown and described herein. For example, those skilled in the art 
will understand and appreciate that a methodology could alternatively be represented as a 
series of interrelated states, such as in a state diagram. Moreover, not all illustrated blocks 
may be required to implement a methodology in accordance with an aspect of the present 

20 invention. 

Referring to Fig. 9, and proceeding to block 150, a set and/or chain of contour pixels 
is selected, wherein the perimeter of the foreground region within an image is identified as 
described above. At block 1 54, a subpixel edge offset determination is performed on each 
contour pixel selected in block 1 50. As described above, an edge orientation may first be 
25 determined by taking the gradient of the image with respect to each contour pixel. Once the 

edge orientation has been determined, the edge offset may be determined by determining 
gradient magnitude values along the image gradient, and then applying a curve to the gradient 
magnitudes in order to determine the degree of offset the contour edge is fi:om the center of 
the contour pixel. At block 1 58, an area is determined for the subpixel area defined by the 
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edge offset determined in block 1 54 and the sides of the contour pixels. After determining 
the subpixel area, an alpha value defining the mixing ratio of foreground and background 
colors may be determined as described above. At block 162, the alpha value is utilized to 
smoothly mix the selected foreground region of block 150 with a second and/or subsequent 
5 background region. 

In order to provide a context for the various aspects of the invention, Fig. 1 0 and the 
following discussion are intended to provide a brief, general description of a suitable 
computing environment in which the various aspects of the present invention may be 
implemented. While the invention has been described above in the general context of 

1 0 computer-executable instructions of a computer program that runs on a computer and/or 

computers, those skilled in the art will recognize that the invention also may be implemented 
in combination with other program modules. Generally, program modules include routines, 
programs, components, data structures, etc. that perform particular tasks and/or implement 
particular abstract data types. Moreover, those skilled in the art will appreciate that the 

1 5 inventive methods may be practiced with other computer system configurations, including 

single-processor or multiprocessor computer systems, minicomputers, mainfi*ame computers, 
as well as personal computers, hand-held computing devices, microprocessor-based or 
programmable consumer electronics, and the like. The illustrated aspects of the invention 
may also be practiced in distributed computing environments where tasks are performed by 

20 remote processing devices that are linked through a communications network. However, 

some, if not all aspects of the invention can be practiced on stand-alone computers. In a 
distributed computing environment, program modules may be located in both local and 
remote memory storage devices. 

With reference to Fig. 10, an exemplary system for implementing the various aspects 

25 of the invention includes a conventional computer 220, including a processing unit 221 , a 

system memory 222, and a system bus 223 that couples various system components including 
the system memory to the processing unit 22 1 . The processing unit 22 1 may be any of 
various commercially available processors. It is to be appreciated that dual microprocessors 
and other multi-processor architectures also may be employed as the processing imit 221 . 
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The system bus may be any of several types of bus structure including a memory bus 
or memory controller, a peripheral bus, and a local bus using any of a variety of conventional 
bus architectures. The system memory may include read only memory (ROM) 224 and 
random access memory (RAM) 225. A basic input/output system (BIOS), containing the 
5 basic routines that help to transfer information between elements within the computer 220, 

such as during start-up, is stored in ROM 224. 

The computer 220 further includes a hard disk drive 227, a magnetic disk drive 228, 
e.g., to read from or write to a removable disk 229, and an optical disk drive 230, e.g., for 
reading from or writing to a CD-ROM disk 23 1 or to read from or write to other optical 

10 media. The hard disk drive 227, magnetic disk drive 228, and optical disk drive 230 are 

connected to the system bus 223 by a hard disk drive interface 232, a magnetic disk drive 
interface 233, and an optical drive interface 234, respectively. The drives and their 
associated computer-readable media provide nonvolatile storage of data, data structures, 
computer-executable instructions, etc. for the computer 220. Although the description of 

1 5 computer-readable media above refers to a hard disk, a removable magnetic disk and a CD, it 

should be appreciated by those skilled in the art that other types of media which are readable 
by a computer, such as magnetic cassettes, flash memory cards, digital video disks, BemouUi 
cartridges, and the like, may also be used in the exemplary operating environment, and 
further that any such media may contain computer-executable instructions for performing the 

20 methods of the present invention. 

A number of program modules may be stored in the drives and RAM 225, including 
an operating system 235, one or more application programs 236, other program modules 237, 
and program data 238, It is noted that the operating system 235 in the illustrated computer 
may be substantially any suitable operating system. 

25 A user may enter commands and information into the computer 220 through a 

keyboard 240 and a pointing device, such as a mouse 242. Other input devices (not shown) 
may include a microphone, a joystick, a game pad, a satellite dish, a scanner, or the like. 
These and other input devices are often connected to the processing unit 221 through a serial 
port interface 246 that is coupled to the system bus, but may be connected by other interfaces, 
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such as a parallel port, a game port or a universal serial bus (USB). A monitor 247 or other 
type of display device is also connected to the system bus 223 via an interface, such as a 
video adapter 248. In addition to the monitor, computers typically include other peripheral 
output devices (not shown), such as speakers and printers. 
5 The computer 220 may operate in a networked environment using logical connections 

to one or more remote computers, such as a remote computer 249. The remote computer 249 
may be a workstation, a server computer, a router, a peer device or other common network 
node, and typically includes many or all of the elements described relative to the computer 
220, although only a memory storage device 250 is illustrated in Fig. 10. The logical 

10 connections depicted in Fig. 10 may include a local area network (LAN) 251 and a wide area 
network (WAN) 252. Such networking environments are commonplace in offices, 
enterprise-wide computer networks, Intranets and the Internet. 

When employed in a LAN networking environment, the computer 220 may be 
connected to the local network 251 through a network interface or adapter 253. When 

1 5 utilized in a WAN networking environment, the computer 220 generally may include a 

modem 254, and/or is connected to a communications server on the LAN, and/or has other 
means for establishing communications over the wide area network 252, such as the Internet. 
The modem 254, which may be internal or extemal, may be connected to the system bus 223 
via the serial port interface 246. In a networked environment, program modules depicted 

20 relative to the computer 220, or portions thereof, may be stored in the remote memory storage 
device. It will be appreciated that the network connections shown are exemplary and other 
means of establishing a communications link between the computers may be employed. 

In accordance with the practices of persons skilled in the art of computer 
programming, the present invention has been described with reference to acts and symbolic 

25 representations of operations that are performed by a computer, such as the computer 220, 

unless otherwise indicated. Such acts and operations are sometimes referred to as being 
computer-executed. It will be appreciated that the acts and symbolically represented 
operations include the manipulation by the processing unit 221 of electrical signals 
representing data bits which causes a resulting transformation or reduction of the electrical 
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signal representation, and the maintenance of data bits at memory locations in the memory 
system (including the system memory 222, hard drive 227, floppy disks 229, and CD-ROM 
23 1) to thereby reconfigure or otherwise alter the computer system^s operation, as well as 
other processing of signals. The memory locations wherein such data bits are maintained are 

5 physical locations that have particular electrical, magnetic, or optical properties 

corresponding to the data bits. 

What has been described above are preferred aspects of the present invention. It is, of 
course, not possible to describe every conceivable combination of components or 
methodologies for purposes of describing the present invention, but one of ordinary skill in 

10 the art will recognize that many further combinations and permutations of the present 

invention are possible. Accordingly, the present invention is intended to embrace all such 
alterations, modifications and variations that fall within the spirit and scope of the appended 
claims. 
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